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THE  PROBLEM 


Peer  ratings  have  proved  to  be  useful  instruments  in  appraising  the  potential 
of  individual  cadets  in  the  Naval  Air  Training  Program.  Almost  half  of  the  students 
in  naval  air  training,  however,  are  officers  rather  than  cadets.  A  valid  rating  of 
the  training  potentiol  of  these  would  biso  be  useful.  There  is  a  considerable 
difference,  however,  between  the  cadet  and  officer  situation  during  the  early  stage 
of  training;  in  contrast  to  the  cadets'  ”around~the“clocl<"  mutual  association,  the 
officer  students  are  associated  as  a  group  only  during  academic  and  physical  training 
instruction.  ^  ^  , 

predictive  validity  of  peer  ratings  administered  to 
28  classes  of  officer  students^^TThe  predictive  validity  of  these  ratings  is  compared 
with  that  of  similar  ratings  executed  by  28  classes  of  cadets.  Multiple  correlation 
procedures  were  used  to  determine  the  extent  to  which  the  peer  ratings  made  an 
independent  contribution  to  the  predictive  validity  of  the  selection  test  scores  and 
training  grades.  \ 
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/' 

^t  was  found  that  while  the  cadet  peer  ratings  made  a  substantial  contribution 
to  the  multiple  validity  for  predicting  success,  the  officer  peer  ratings  did  not.  i 
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introductiorTof  officer  peer  rdtings  as  a  regular  evaluation  device 

i\  av 


in 


naval  aviation  training  would  not  be  justified  by  the  findings  of  the'study. 
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INTRODUCTION 


Peer  ratings,  i.e,,  evaluations  af  the  members  of  a  group  by  one  or  more  other 
members  af  tha^ group,  have  proved  to  be  useful  instruments.  Although  usually  made 
by  untrained  and  relatively  unsophisticated  observers,  such  ratings  have  been  shav/n 
ta  be  good  predictors  af  success  ar  failure  In  several  areas  of  endeavor. 

Williams  cmd  Leavitt  (6)  Investigated  peer  nominations  as  predictors  af  Officer 
Candidate  School  (OCS)  grades  and  leadership  performance  in  combat.  Far  both  af 
these  behaviors  peer  ratings  were  found  to  be  superior  ta  several  abjective  tests  and 
ta  ratings  by  superiors.  The  outhars  attributed  this  ta  the  fact  that  "group  members 
have  more  time  ta  observe  each  other  than  da  superior  officers,  they  know  each  other 
In  a  realistic  social  context,  and  they  react  directly  ta  each  ath^'s  social  dominance 
behavior. " 

La  Galpa  (3)  found  that  none  af  the  OCS  selection  variables  used  at  Newport 
predicted  on-the-jab  success  as  measured  by  fitness  reports  far  officers  assigned  ta 
either  shore  ar  fleet  billets.  However,  a  significant  correlation  of  .23  resulted 
between  peer  ratings  administered  In  the  eleventh  week  af  OCS  training  and  the 
later  fitness  reports  af  bath  share  and  fleet  assigned  officers. 

Baier  (1)  has  shown  that  peer  naminatians  at  West  Point  were  more  highly 
related  ta  later  performance  as  officers  than  was  scholastic  standing;  and  Rigby  and 
Ossoria  (5)  reported  that  peer  ratings  administered  early  in  the  training  af  Naval 
and  Marine  Corps  women  recruits  discriminated  between  successful  and  nonsuccessful 
trainees. 

Since  1957  such  peer  ratings  have  been  among  the  measures  used  in  the  Naval 
Air  Training  Program  to  appraise  the  potential  af  individual  cadets.  These  ratings 
are  administered  during  the  eighth  week  of  pre-flight  school  training.  This  training 
situation  Is  quite  similar  ta  that  at  OCS,  Newport,  inasmuch  as  the  cadets  are 
divided  into  classes  and  attend  all  phases  af  military,  academic,  and  physical 
training  as  a  class.  In  addition,  they  eat  together  and  live  in  the  same  quarters. 

The  two  situations  are  also  similar  in  that  bath  are  af  sixteen  weeks  duration  and 
upon  completion  cadets  with  college  degrees  are  cammissianed.  The  peer  rating 
format  used  in  naval  air  training  calls  far  each  man  in  a  class  of  cadets  to  name  the 
three  most  promising  prospective  officers  and  the  three  least  promising  in  his  class. 

It  has  been  shown  (2,4)  that  these  ratings,  when  pooled,  typical sy  have  bi-serial 
correlations  af  about  .35  ta  .40  with  subsequent  failure  ta  complete  the  training 
program,  and  that,  when  combined  with  other  measures,  they  have  considerable 
administrative  usefulness. 


1 


Almost  half  of  the  students  in  naval  air  training,  however,  are  officers  rather 
than  cadets.  A  valid  rating  of  the  training  potential  of  these  men  \would  also  be 
administratively  useful.  There  is  a  considerable  difference,  however,  between  the 
cadet  and  the  officer  situations  at  this  stage  of  training.  In  contrast  to  the  cadets' 
"around-the-clock"  mutual  association,  the  officer  students  as  a  class  go  only  to 
academic  and  physical  training  Instruction  together.  After  the  working  day  they 
go  their  own  separate  ways,  either  home  to  their  families,  or  to  some  type  of 
bachelor  quarters. 

Since  the  officer  student  is  with  most  of  his  peers  only  during  periods  of  training, 
the  question  that  needed  answering  was,  "Do  the  officer  students  gain  as  good  insight 
Into  their  peers'  potential  as  do  cadets,  without  the  cadets'  opportunity  to  observe 
'around-the-clock'  behavior?" 


PROCEDURE 

From  June  1960  to  July  1961  peer  ratings  were  obtained  from  28  officer  student 
classes  (N  =  606)  who  were  in  their  tenth  week  of  pre-flight  training.  These  ratings 
were  compared  with  later  success  in  flight  training  as  indicated  by  whether  or  not  the 
officer  was  still  in  the  program  at  the  end  of  basic  training  (about  ten  months  later). 

All  but  about  4  per  cent  of  the  failures  and  withdrawals  customarily  take  place  before 
this  point  in  training.  The  bi-serial  correlation  coefficient  was  computed.  For  com¬ 
parative  purposes  the  some  computation  was  made  of  the  validity  of  peer  ratings  for 
28  cadet  classes  (N  =  666)  who  went  through  pre-flight  school  during  1959. 

Since  a  new  measurement  procedure  is  useful  only  if  it  adds  to  the  predictive 
validity  of  other  measurements  already  in  use,  multiple  correlation  analysis  seemed 
appropriate.  Available  for  this  purpose  were  scores  from  three  aptitude  tests  —  the 
Spatial  Apperception  Test  (SAT),  the  Mechanical  Comprehension  Test  (MCT),  ancT 
the  Aviation  Qualification  Test  (AGT);  the  Biographical  Inventory  (Bl);  four  academic 
grades  —  aviation  physiology  (AP),  engines  (ENG),  aerodynamics  (AERO),  and 
navigation  (NAV);  and  a  physical  training  (PT)  grade. 

Two  multiple  correlations  were  computed  for  both  the  officer  and  cadet  groups. 
One  of  the  multiple  correlations  for  each  group  included  the  peer  rating  score;  the 
other  did  not.  Comparison  of  the  two  correlations  indicates  the  peer  rating's  value 
as  an  added  predictor  of  failure  to  complete  flight  training. 
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RESULTS  AND  DISCUSSION 


The  bi“serial  correlations  of  the  peer  ratings  with  their  respective  criteria 
were  .20  for  the  officer  students  and  .36  for  the  cadets.  The  cadet  peer  rating  is 
by  for  the  more  valid  predictor.  However,  a  correlation  of  .20  has  value  if  it  adds 
any  unique  variance  to  a  battery  of  predictors. 

The  results  expressed  in  Table  I  unequivocally  deny  any  such  potential.  The 
multiple  correlation  for  the  officer  student  group  reaches  a  maximum  of  .49,  with 
the  peer  rating  contributing  nothing  to  the  multiple.  In  contrast,  the  cadet  peer 
rating  is  second  only  to  the  navigation  grade  in  contribution  to  the  multiple.  The 
cadet  multiple  correlation  which  includes  peer  rating  scores  is  .56;  when  the  same 
multiple  is  computed  omitting  the  peer  rating,  it  is  only  .51  . 

Table  I 


Comparison 

of  the  Multiple  Correlations  of  Officers'  and  Cadets'  Selection, 

Training, 

and  Peer  Rating  Scores  with  a 

"Failure  to  Complete" 

Criterion 

Officers 

Cadets 

Variable 

Multiple  R* 

Variable 

Multiple  R 

AERO 

.37 

NAV 

.39 

MCT 

.42 

P-R 

.48 

PT 

.45 

ENG 

.51 

SAT 

.47 

SAT 

.53 

Bl 

.48 

PT 

.54 

NAV 

.49 

Bl 

.55 

AQT 

.49 

AERO 

.55 

ENG 

.49 

AP 

.56 

*  Determined  by  Wherry-Doolittle  procedure 


The  intercorrelations  shown  in  Table  81  partially  explain  these  results.  The 
peer  rating  scones  of  the  officer  students  correlate  consistently  higher  with  the 
training  grades  than  do  the  cadet  peer  rating  scores.  The  officer  students  apparently 
were  basing  their  judgments  of  their  peers  more  on  classroom  behavior  than  were  the 
cadets. 
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Table  II 


Intercorrelation  of  Variables  for  Officer  Student  and  Cadet  Groups* 


P-R  AP 

ENG 

AERO 

PT 

NAV 

SAT 

Bl 

MCT 

AQT 

P-R 

.23 

.36 

.30 

.24 

.28 

.05 

.08 

.19 

.11 

.11 

.12 

.19 

.23 

.25 

.12 

.12 

.08 

.13 

AP 

.55 

.45 

.08 

.33 

.12 

.10 

.38 

.33 

.41 

.34 

.00 

.24 

.05 

.07 

.24 

.26 

ENG 

.64 

.12 

.46 

.17 

.16 

.51 

.31 

.45 

-.03 

.41 

.05 

.06 

.41 

.27 

AERO 

.27 

.59 

.12 

.14 

.49 

.44 

.00 

.53 

.14 

-.07 

.44 

.61 

PT 

.15 

.00 

.12  " 

.09 

.08 

-.03 

.02 

.04 

-.05 

-.06 

NAV 

.16 

.10 

.33 

.48 

.17 

-.03 

.26 

.42 

SAT 

.04 

.25 

.21 

-.05 

.12 

.16 

Bl 

.15 

.04 

.02 

.00 

MCT 

.36 

.28 

AQT 

* 

The  upper  correlation  is  for  the  officer  student  group  while  the  lower  correlation 
is  that  of  the  cadet  group. 
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Thus  the  officer  peer  ratings  contributed  nothing  new  to  the  predictive 
validity  of  the  training  and  selection  scores.  Cadet  peer  ratings,  on  the  other 
hand,  were  apparently  based  on  observed  aspects  of  behavior  which  were 
important  to  later  success  in  training  and  which  were  not  so  highly  reflected  by 
the  other  available  measures. 

The  difference  between  the  contributions  of  the  cadet  and  officer  peer 
ratings  can  be  most  easily  attributed  to  their  differences  in  opportunity  to 
observe  their  peers  under  a  variety  of  circumstances.  It  must  be  concluded 
that  the  introduction  of  officer  peer  ratings  as  a  regular  evaluation  device  in 
naval  aviation  training  would  not  be  justified  by  the  findings  of  this  study. 
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